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Simple Linear Regression Model 


8.5.1 Simple Linear Regression Model 

Here, we provide a model that is called the simple linear regression model. Our model is 

Yi — A) + Pi %i + , 

where we model €i 's as independent and zero-mean nonnal random variables, 

d ~ iV(0, cr 2 ). 

The parameters /3q , , and <7 2 are considered fixed but unknown. The assumption is that we 

have data points [Xi, yi), (x2,l/2), ' ' ", {Xml/n) an d our goal is to find the "best" values 
for /3q and (5\ resulting in the line that provides the "best" fit for the data points. Here, t/ ? ;'s 
are the observed values of the random variables Y^'s. To have a well-defined problem we add 
the following assumptions. We assume TL > 3. We also assume that not all Xj's are identical. 

There are several common methods for finding good values for (3q and . These methods 
will result in the same answers; however, they are philosophically based on different ideas. 
Here, we will provide two methods for estimating (3q and /3\ . A third method will be 
discussed in the Solved Problems section. 
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